🕷️️ Job Radar • SCRAPING

freelancer.com 2026-04-19 🟠

🔹 Remove Duplicate Emails Fast
👤 Client: 🇧🇯 Abuja, Benin Member since 2025-09-21
💰 Price: $18 Average bid
🚩 Problem: Strip duplicates from mixed-format email lists in plain-text files.
📦 Existing: Not specified

Specifications:

[Target] Parse .txt files containing emails in various formats (single lines, comma-separated strings, embedded within text).
[Method] Use regular expressions or scripting languages like Python/PowerShell to extract and deduplicate email addresses case-insensitively.
[UI/UX] Not applicable
[Stack] Python/PowerShell with regex for parsing and deduplication.
[Security] Ensure no sensitive data is exposed during processing. Use secure methods for handling files.
[Format] Output a single .txt or CSV file containing unique email addresses, include count of duplicates removed.

Workflow:

1. Read each .txt file line by line to extract potential email addresses.
2. Validate extracted strings as emails using regex patterns.
3. Normalize and compare email addresses case-insensitively to identify duplicates.
4. Remove duplicate entries, keeping the first occurrence of each unique email.
5. Write the cleaned list to a new .txt or CSV file with a note on number of duplicates removed.